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DATA PLAYER, DIGITAL CONTENTS PLAYER, PLAYBACK SYSTEM, 
DATA EMBEDDING APPARATUS, AND 
EMBEDDED DATA DETECTION APPARATUS 
FIELD OF THF, INVENTION 

The present invention relates to a data player, a playback 
system, a data embedding apparatus, and an embedded data 
detection apparatus, which are able to detect or prevent illegal 
use of contents of dxgital media when the contents are 
copyrighted . 

BACKGROUND OF TH F. TNVENTION 

There is a digital versatile disk player (DVD player) as an 
example of a conventional data player. In a DVD player, data 
written on a disk (DVD) is encrypted so that a player which does 
not adopt means for copyright protection cannot play the data on 
the disk and, therefore, only a player which is legally provided 
with a key can play the disk. Generally, the key required for 
playback is given to each DVD player. 

Hereinafter, an example of a conventional data player will 
be described with reference to figure 18. 

Figure 18 is a block diagram illustrating an example of a 
conventional data player. 

In figure 18, reference numeral 1000 designates a key 
storage unit which stores a contents key for decoding encrypted 
contents 1202 recorded on a digital medium 1200, and reference 
numeral 1100 designates a data player. The key storage unit 1000 



comprises a controller 1001 and a key storage 1002 which stores 
the contents key. The data player comprises a controller 1101, a 
contents key holder 1102 which takes the contents key from the 
key storage unit 1000 and holds it, a reader 1104 which reads the 
encrypted contents 1202 from the digital medium 1200, an 
encrypted contents decoder 1105 which decodes the encrypted 
contents 1202, a player 1106 which plays the decoded contents, a 
signal output unit 1107 which outputs the contents to the outside, 
and a user operation input unit 1108 which transmits an 
instruction from the user to the controller 1101. 

Hereinafter, a description will be given of the operation of 
the data player 1100 in the case where the user instructs the 
data player 1100 to play the contents of the digital medium 1200, 
through the user operation input unit 1108 . 

Before playing the encrypted contents 12 02, the data player 
1100 communicates with the controller 1001 of the key storage 
unit 1000 using the controller 1101, and proves that it is 
eligible to play the encrypted contents 1202 in the digital 
medium 1200. When the controller 1001 of the key storage unit 
1000 confirms that the data player 1100 is eligible for playback, 
the data player 1100 receives the contents key from the key 
storage unit 1000 and stores it in the contents key holder 1102. 
Thereafter, the reader 1104 reads the encrypted contents 1202 
from the digital medium 1200, and the decoder 1105 decodes the 
encrypted contents 1202 using the contents key which has been 
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stored, thereby obtaining plaintext contents. The plaintext 
contents are played by the player 1106 and then outputted as a 
signal by the signal output unit 1107. In this construction, 
when performing playback of specific encrypted contents -existing 
on a digital medium, the data player 1100 is confirmed by the key 
storage unit 1000 as to whether it is eligible for playing the 
encrypted contents or not. Thereby, the encrypted contents on 
the digital medium are prevented from being played by an illegal 
player which is not eligible for playback. 

On the other hand, with respect to electronic distribution 
of movies to theaters or video services in airplanes, there are 
some movies which have not yet been released in theaters and, 
therefore, it is desired that the periods during which these 
movies can be played are controllable. As a system for accessing 
such data, Japanese Published Patent Application No. Hei.10- 
341212 discloses an encryption text transmission system. In this 
system, a key is provided with data about its available period or 
place, and the present time or position is detected when using 
the key, whereby the use of the key can be controlled according 
to whether the present time is within the available period or 
whether the present position where the key is used is within the 
available place. Further, the use of the key can be controlled 
by periodically recording time data and comparing the time data 
with the present time. 

Further, it has been proposed that, when playing data, the 
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ID number of a player which plays the data is embedded in the 
played data. Thereby, if the played data is illegally copied and 
sold, a player which assisted the illegal act can be identified. 

In the conventional data player, however, once a data player 
is recognized as being eligible for playing specific contents by 
the key storage unit and then obtains a contents key and stores 
it in the contents key storage, the player can illegally plays 
other encrypted contents by using the stored contents key even 
when the player is not eligible to play the contents. 

Further, in the method disclosed in Japanese Published 
Patent Application No. Hei . 10-341212,, since the time data or 
position data is judged after transmitting the key^ to the player 
end, there is a risk that the key is obtained illegally. Further, 
there is a risk that the recorded time data is altered and the 
key is obtained illegally. 

Furthermore, in the case where the data such as the player's 
ID number is embedded in the played data, the embedded data must 
be detected correctly. However, when the number of embedded data 
increases, it is difficult to detect all of them correctly and, 
further, there is no means to confirm whether the result of 
detection is correct or not. 
SUMMARY OF THE TNVF.NTTON 

The present invention is made to solve the above-described 
problems and has for its object to provide a data player, a 
digital contents playet, a playback system, a data embedding 
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apparatus, and an embedded data detection apparatus, for 
preventing illegal access by a player having no access right or 
illegal playback of data by illegally controlling time data, and 
for detecting or preventing illegal use of copyrighted data, such 
as illegal copying. 

Other objects and advantages of the invention will become 
apparent from the detailed description that follows. The 
detailed description and specific embodiments described are 
provided only for illustration since various additions and 
modifications within the scope of the invention will be apparent 
to those of skill in the art from the detailed description. 

According to a first aspect of the present invention, there 
is provided a data player for reading contents encrypted by a 
decoding key from a digital medium, and playing the encrypted 
contents by using the decoding key which is stored in a key 
storage unit. This data player comprises key obtaining means for 
performing mutual authentication with the key storage unit to 
obtain the decoding key stored in the key storage unit; key 
holding means for holding the decoding key; playback state 
obtaining means for monitoring the playback state of the digital 
medium; and contents decoding means for decoding the encrypted 
contents by using the decoding key. The decoding key is obtained 
by the key obtaining means and stored m the key holding means, 
the encrypted contents read from the digital medium is decoded 
with the decoding key by the contents decoding means .to play the 
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contents, and the decoding key stored in the key holding means is 
discarded according to the playback state of the digital medium 
which is obtained by the playback state obtaining means. 
Therefore, illegal use of the key is avoided, whereby illegal 
playback of the contents by an ineligible player is avoided. 

According to a second aspect of the present invention, in 
the data player of the first aspect, the decoding key- stored in 
the key holding means is discarded when it is confirmed that the 
playback state of the digital medium has become " STOP STATE" . 
Since the playback state of the player is always monitored and 
the key is discarded when the playback state has become "STOP 
STATE", illegal use of the key is avoided. 

According to a third aspect of the present invention, in the 
data player of the first or second aspect, the digital medium is 
a DVD. Therefore, illegal playback of the contents in the DVD by 
an ineligible player is avoided. 

According to a fourth aspect of the present invention, there 
is provided a data player for reading contents encrypted by a 
contents key and the contents key encrypted by a decoding key, 
from a digital medium, and playing the encrypted contents by 
using the decoding key which is stored in a key storage unit. 
This data player comprises key obtaining means for performing 
mutual authentication with the key storage unit to obtain the 
decoding key stored in the key storage unit; key holding means 
for holding the decoding key; playback state obtaining means for 



monitoring the playback state of the digital medium; encrypted 
contents key decoding means for decoding the encrypted contents 
key by using the decoding key to obtain the contents key; and 
encrypted contents decoding means for decoding the encrypted 
contents by using the contents key. The decoding key is obtained 
by the key obtaining means and stored m the key holding, unit , 
the encrypted contents key read from the digital medium is 
decoded with the decoding key by the contents key decoding means 
to obtain the contents key, the encrypted contents" read from the 
digital medium is decoded by using the contents key to play the 
contents, and the decoding key stored in the key holding means is 
discarded according to the playback state of the digital media 
which is obtained by the playback state obtaining means. 
Therefore, illegal use of the key is avoided, whereby illegal 
playback of the contents by an ineligible player is avoided. 

According to a fifth aspect of the present invention, in the 
data player of the fourth aspect, the decoding key stored in the 
key holding means is discarded when it is confirmed that the 
playback state of the digital medium has become "STOP STATE" . 
Since the playback state of the player is always monitored and 
the key is discarded when the playback state has become "STOP 
STATE", illegal use of the key is avoided. 

According to a sixth aspect of the present invention, in the 
data player of the fourth or fifth aspect, the digital medium is 
a DVD, Therefore, illegal playback of the contents in the DVD by 
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an ineligible player is avoided. 

According to a seventh aspect of the present invention, 
there is provided a key storage device comprising decoding key 
storage means for storing a decoding key for decoding encrypted 
data recorded on a digital medium; key read authorization means 
for authorizing an external device to read the decoding key when 
the external device plays the encrypted data; and key read 
history recording means for recording the readout record of the 
decoding key to the external device. The decoding key includes 
available period data which is the available period for reading 
the decoding key, and the key read authorization means receives a 
key request signal including a key read time which is the time 
when the external device made a request to read the decoding key, 
and authorizes the external device to read the decoding key after 
confirming that the key read time is later than the latest time 
amongst the read history data of the decoding key which is stored 
in the key read history storage means, and that the key request 
time is within the key read available period, and that rhe key 
read history data has been recorded by the key read history 
recording means. Therefore, an illegality relating to the key 
with the available period, such as setting back the time to be 
declared, is avoided, whereby illegal reception of the key is 
avoided. 

According to an eighth aspect of the present invention, in 
the key storage device of the seventh aspect, the key read 



history recording unit generates and records, in addition to the 
key read history data, an alteration detection code by which 
alteration on the key read history data can be detected. 
Therefore, alteration of the key read history data is made 
difficult . 

According to a ninth aspect of the present invention, in the 
key storage device of the seventh or eighth aspect, the key read 
authorization means authorizes the external device to read the 
decoding key after confirming that the key read history data is 
not altered, from the alteration detection code added to the key 
read history data- Therefore, illegal use of the key by altering 
the key read history data is avoided. 

According to a tenth aspect of the present invention, in the 
key storage device of the seventh aspect, the key read history 
recording means has a predetermined storage capacity, and the key 
read authorization means does not authorize the external device 
to read the decoding key when the key read history data has 
reached the storage capacity of the key read history recording 
means. Therefore, an upper bound is set in access to the key, 
where by the number of times the key is illegally used is limited. 

According to an eleventh aspect of the present invention, 
there is provided a data player for reading data encrypted by a 
decoding key from a digital medium, and playing the data. This 
data player comprises key obtaining means for obtaining the 
decoding key for decoding the encrypted data, from a key storage 
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unit which stores the decoding key; decoding means for decoding 
the encrypted data obtained from the digital medium,' -by using the 
decoding key; data embedding means for embedding data in the data 
decoded by the decoding means; and device ID code storage means 
for storing the device ID code of this data player. The decoding 
key is obtained by the key obtaining means, and a key read time 
at which a request to read the decoding key was made and the 
device ID code of the data player are embedded in the decoded 
data by the data embedding means. Therefore, the key read time 
data and the device ID code of the data player, which are 
embedded in the decoded data, can be used to specify an illegal 
user . 

According to a twelfth aspect of the present invention, in 
the data player of the eleventh aspect, the key obtaining means 
reads the ID code of the key storage unit which stores Mia 
decoding key, together with the decoding key, from the key 
storage unit, and the data embedding means further embeds the ID 
code of the key storage unit in the decoded data. Since the ID 
code of the key storage unit is also embedded in the decoded data 
the data for specifying the illegal user is increased. 

According to a thirteenth aspect of the present invention, 
in the data player of the eleventh or twelfth aspect, the data 
embedding means comprises sequence generation means for' 
converting a pattern to be embedded into a sequence to be 
embedded m each video frame, and embedding means for embedding 
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the sequence in each video frame by watermarking. The sequence 
generation means converts the pattern to be embedded into the 
sequence to be embedded such that short-period patterns and a 
long-period pattern are mixed in the sequence, the short-period 
patterns are obtained by dividing the pattern to be embedded 
according to the number of bits to be embedded in each frame and 
embeddxng the bits in each frame, and the long-period pattern is 
obtained by dividing the pattern to be embedded, bit by bit, and 
embedding the divided bits over plural frames which are plural 
times as many as the number into which the pattern to be embedded 
is divided. Therefore, the key read time data or the id code of 
the key storage unit is converted into a bit sequence which is 
resistive to alteration and then embedded in the decoded data, 
and the embedded data can be used to specify an illegal user. 

According to a fourteenth aspect of the present invention, 
in the data player of the thirteenth aspect, the key obtaining 
means generates a key read history signal including the key read 
time and the device ID code of this data player, and transmits 
this signal to the key storage unit which stores the decoding key. 
Therefore, key read history data including the same data as the 

embedded data is formed. 

According to a fifteenth aspect of the present invention, 
there is provided a digital contents player for reading data 
encrypted by a decoding key from a digital medium, -and playing 
the data. This digital contents player comprises key storage 
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means for storing the decoding key for decoding the encrypted 
data; and data playback means for reading the decoding key from 
the key storage means, and playing the data using the decoding 
key. The data playback means and the key storage means are 
removable from each other. When the data playback means reads 
the decoding key, the key storage means records key read history 
data including a device ID code of this digital contents player 
and a key read time when a request to read the decoding key was 
made. The data playback means embeds the key read time and the 
device ID code in the data played with the decoding key. 
Therefore, the key read time data and the device ID code of the 
digital contents player can be embedded in the decoded data. 

According to a sixteenth aspect of the present invention, in 
the digital contents player of the fifteenth aspect, the data to 
be embedded is converted into a sequence to be embedded in each 
video frame, and then embedded by watermarking. The sequence to 
be embedded is a mixture of short-period patterns and a long- 
period pattern, and the short-period patterns are obtained by 
dividing the pattern to be embedded according to the number of 
bits to be embedded in each frame and embedding the bits in each 
frame, and the long-period pattern is obtained by dividing the 
pattern to be embedded, bit by bit, and embedding the divided 
bits over plural frames which are plural times as many as the 
number into which the pattern to be embedded is divided. 
Therefore, the key read time data or the device ID code of the 



13 



digital contents player is converted into a bit sequence 
resistive to alteration, and embedded in the decoded data. 

According to a seventeenth aspect of the present invention, 
there is provided a key read history recording method comprising: 
recording available period data which is the available period for 
reading a decoding key for decoding encrypted data; recording, as 
a key nonuse period, a difference between a key read time when a 
request to read the decoding key was made and a time which, has 
been recorded at a time that is previous and nearest to the key 
read time; recording key read history data including the key read 
time and the device ID code of a data player; and recording the 
time when use of the decoding key has ended, as an end-of-key-use 
time. Therefore, the time data is prevented from going backward, 
whereby illegal use of the key is avoided. 

According to an eighteenth aspect of the present invention, 
there is provided a data embedding apparatus comprising sequence 
generation means for converting a pattern to be embedded into a 
sequence to be embedded in each video frame, and embedding means 
for embedding the sequence in each video frame by watermarking. 
The sequence generation means converts the pattern to be embedded 
into the sequence to be embedded in which short-period patterns 
and a long-period pattern are mixed, the short-period patterns 
are obtained by dividing the pattern to be embedded according to 
the number of bits to be embedded in each frame and embedding the 
bits in each frame, and the long-period pattern is obtained by 
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dividing the pattern to be embedded, bit by bit, and embedding 
the divided values over plural frames which are plural, times as 
many as the number into which the pattern to be embedded is 
divided. Therefore, a data embedding apparatus which can form a 
pattern to be embedded, which is resistive to alteration, is 
realized * 

According to a nineteenth aspect of the present invention, 
there is provided a data embedding apparatus comprising real time 
measuring means for outputting real time data which specifies the 
present time, and data embedding means for embedding the real 
time data in video/audio data. Therefore, the video/audio signal 
which can specify the time data is output, and an illegal user 
can be specified according to the time data. 

According to a twentieth aspect of the present invention, in 
the data embedding apparatus of the nineteenth aspect, the data 
embedding means embeds the real time data at the time when the 
video/audio data is input to this apparatus, in the video/audio 
data which is input in the visible/audible state to this 
apparatus. Therefore, the video/audio data which can specify the 
time data at the time when an illegality was performed is output, 
and the illegal user can be specified according to the time data. 

According to a twenty-first aspect of the present invention, 
there is provided a data embedding apparatus comprising real 
position measuring means for outputting real position data which 
specifies the present physical position, and data embedding means 
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for embedding the real position data in video/audio data. 
Therefore, the video/audio signal which can specify the position 
data is output/ and an illegal user can be specified according to 
the position data. 

According -to a twenty-second aspect of the present invention, 
in the data embedding apparatus of the twenty-first aspect, the 
data embedding means embeds the real position data at the time 
when the video/audio data is input to this apparatus, in the 
video/audio data which is input in the visible/audible state to 
this apparatus. Therefore, the video/audio signal which can 
specify the position data at the time when an illegality was 
performed is output, and the illegal user can be specified 
according to the position data. 

According to a twenty-third aspect of the present invention, 
there is provided a data embedding method comprising a real time 
measuring step of outputting real time data which specifies the 
present time, and a data embedding step, of embedding the real 
time data in video/audio data. Therefore, the video/audio signal 
which can specify the time data is output, and an illegal user 
can be specified according to the time data. 

According to a twenty-fourth aspect of the present invention, 
in the data embedding method of the twenty-third aspect, the real 
time data at the time when the video/audio data is input, is 
embedded in the video/audio data which is input in- the 
visible/audible state. Therefore, the video/audio signal which 
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can specify the time data at the time when an illegality was 
performed is output, and the illegal user can be specified 
according to the time data. 

According to a twenty-fifth aspect of the present invention, 
there is provided a data embedding method comprising a real 
position measuring step of outputting real position data which 
specifies the present position, and a data embedding step of 
embedding the real position data in video/audio data.- Therefore, 
the video/audio signal which can specify the position data is 
output, and an illegal user can be specified according to the 
position data. 

According to a twenty-sixth aspect of the present invention, 
in the data embedding method of the twenty-fifth aspect, the real 
position data at the time when the video/audio data is input, is 
embedded in the video /audio data which is input in the 
visible/audible state. Therefore, the video/audio signal which 
can specify the position data at the time when an illegality was 
performed, and the illegal user can be specified according to the 

position data. 

According to a twenty-seventh aspect of the present 
invention, there is provided an embedded data detection apparatus 
for detecting embedded data from playback data in which the data 
is embedded by a data embedding apparatus. The data embedding 
apparatus comprises sequence generation means for generating a 
sequence in which short-period patterns and a long-period pattern 
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are mixed, the short-period patterns being obtained by dividing 
the pattern to be embedded according to the number of bits to be 
embedded in each frame and embedding the bits in each frame, and 
the long-period pattern being obtained by dividing the pattern to 
be embedded, bit by bit, and embedding the divided bits over 
plural frames which are plural times as many as the number into 
which the pattern to be embedded is divided; and data embedding 
means for embedding the sequence in each video frame by 
watermarking. The embedded data detection apparatus comprises 
intra-frame embedded data detection means for detecting the 
embedded pattern from each video frame; short-period embedded 
pattern detection means for calculating the embedded pattern from 
the embedded pattern detected by the intra-frame embedded data 
detection means, with reference to shirt-circuit embedded bits; 
and long-period embedded pattern detection means for calculating 
the embedded pattern with reference to long-period embedded bits. 
Therefore, this apparatus can detect the embedded data which is 
embedded by using the short-period patterns and the long-period 
pattern and is resistive to alteration. 

According to a twenty-eighth aspect of the present invention, 
there is provided an embedded data confirming method comprising: 
detecting embedded data from visible/audible data in which real 
time data that can specify the present time, real position data 
that can specify the present position, or a device* ID code of a 
device for playing the visible /audible data is embedded; and- 
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collating the detected data with a data base containing the 
history of the embedded data. Therefore/ the detected data can 
be collated with the history data base, whereby an illegal user 
is traced with higher efficiency. 

According to a thirtieth aspect of the present invention, 
there is provided a playback system comprising a data output unit 
for outputtmg data, and a data player. The data player 
comprises decoding means for decoding input data to video/audio 
data which is visible or audible, real time measuring means for 
outputting real time data which can specify the present time, and 
data embedding means for embedding the real time data in the 
video/audio data. The real time data measured by the real time 
measuring means at the time when the data player plays the input 
data is embedded in the video/audio data. Therefore, the time 
data at the time when an illegality was performed can- be embedded 
in the decoded video/audio signal, and an illegal user can be 
specified according to the embedded time data. 

According to a thirty-first aspect of the present invention, 
the playback system of the thirtieth aspect comprises one piece 
of the real time measuring means, and at least one piece of the 
data output unit. Therefore, in the system having plural players 
the time data embedded in the video/audio signal can be used to 
specify an illegal user. Further, the time data is prevented 
from varying between the plural players, and the number of lines 
used for transmission is reduced. 



19 



According to a thirty-second aspect of the present invention 
there is provided a playback system comprising a data output unit 
for outputting data, and a data player. The data player 
comprising decoding means for decoding input data to video/audio 
data which is visible or audible, real position measuring means 
for outputting real position data which can specify the present 
position, and data embedding means for embedding the real 
position data in the video/audio data. The real position data 
measured by the real position measuring means at the time when 
the data player plays the input data is embedded in the 
video/audio data. Therefore, the position data at the time when 
an illegality was performed can be embedded in the decoded 
video/audio signal, and an illegal user can be specified 
according to the embedded position data. 

According to a thirty-third aspect of the present invention, 
the playback system of the thirty-second aspect comprises one 
piece of the real position measuring means, and at least one 
piece of the data output unit. Therefore, in the system having 
plural players, the position data embedded in the video/audio 
signal can be used to specify an illegal user. Further, the 
position data is prevented from varying between the plural 
players, and the number of lines used for transmission is reduced 
rrtff de scription of the DRAWINGS 

Figure 1 is a block diagram illustrating an example of a 
data player according to a first embodiment of the present 
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invention. 

Figure 2 is a flowchart illustrating an example of operation 
of the data player according to the first embodiment. 

Figure 3 is a block diagram for explaining the case where 
the data player according to the first embodiment is judged as an 
illegal one. 

Figure 4 xs a block diagram illustrating a an example of a 
system including a data player and a key storage unit according 
to a second embodiment of the present invention. 

-Figure 5 is a flowchart illustrating an example of operation 
of the system according to the second embodiment in the case 
where the data player and the key storage unit perform playback 
of data. 

Figure 6 is a diagram illustrating an example of written 
history data according to the second embodiment. 

Figure 7 is a flowchart illustrating the procedure of 
writing the history data according to the second embodiment. 

Figure 8 is a diagram illustrating a watermark embedding 
apparatus and an embedded data detection apparatus according to 

the second embodiment. 

Figure 9 is a diagram illustrating pattern sequences to be 
embedded in frames, as the result of watermarking according to 
the second embodiment. • „ 

Figure 10 is a diagram illustrating an example of a device 
to specify an illegal device, an illegal key storage unit, or the 



21 

time when an illegal act was carried out, by using the recorded 
history data according to the second embodiment. 

Figure 11 .is a diagram illustrating a data embedding unit 
according to a third embodiment of the present invention. 

Figure 12 is a diagram illustrating a construction . for 
detecting the embedded data according to the third embodiment. 

Figure 13 is a diagram illustrating a playback system 
according to a fourth embodiment of the present invention. 

Figure 14 is a diagram illustrating a playback system having 
a plurality of players, according to the fourth embodiment. 

Figure 15 is a diagram illustrating an example- of a playback 
system according to a fifth embodiment of the invention. 

Figure 16 is a diagram illustrating another example of a 
playback system according to the fifth embodiment. 

Figure 17 is a diagram illustrating still another example of 
a playback system according to the fifth embodiment. 

Figure 18 is a diagram illustrating a conventional data 
player. 

DETAILE D DESCRIPTION OF THE PREFERRED E MBODIMENTS 
[Embodiment 1] 

Hereinafter, a first embodiment of the present invention 
corresponding to Claims 1 to 6 will be described with reference 
to figures 1 to 3. 

Initially, the construction of a data player according to 
the first embodiment will be described with reference to figure i. 



Figure 1 is a block diagram illustrating an example of a 
data player according to the first embodiment. 

In figure 1, reference numeral 10 designates a key storage 
unit, 100 designates a DVD player (data player) , and 20 
designates a DVD (digital medium) - The key storage unit 10 
comprises a controller 11 and a key storage 12 in which a 
contents key decoding key (decoding key) is stored. The contents 
key decoding key is a key for decoding an encrypted contents key 
21 recorded on the DVD 20 to obtain a contents key. The 
controller 11 performs mutual authentication with the DVD player 
100, and permits the DVD player 100 to read the contents key 
decoding key. The DVD player 100 comprises a controller 101 for 
performing mutual authentication with the key storage unit 10 to 
receive key read permission, a contents key decoding key holder 
102 (key holder) for holding the contents key decoding key which 
is read from the key storage unit 10, an encrypted contents key 
decoder 103 for decoding the encrypted contents key, a reader 104 
for reading the contents or the like from the DVD 20, an 
encrypted contents decoder 105 for decoding the encrypted 
contents, a playback unit 106 for playing the decoded data, a 
signal output unit 107 for outputting the data played by the 
playback unit 106, and a user operation input unit 108 for 
sending an instruction from the user to the controller 101. The 
DVD 20 contains the encrypted contents key 21 and the encrypted 
contents 22. The encrypted contents 22 recorded on the DVD 20 
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are obtained by encrypting plaintext contents with the contents 
key, and the encrypted contents key 21 is obtained by encrypting 
the contents key with the contents key decoding key. 

Next, the playback operation of the DVD player 100 will be 
described with reference to figure 2. 

Figure 2 is a flowchart illustrating the operation of the 
DVD player 100 when it plays the contents. Here, a description 
will be given of the case where the user instructs' the DVD player 
100 to play the contents on the DVD 20, through the user 
operation input unit 108. 

Initially, when the DVD player 100 is instructed by the user 
through the user operation input unit 108 so as to play the 
contents 22 on the DVD 20 {step S100), the DVD player 100 
communicates with the controller 11 of the key storage unit 10 by 
using the controller 101 to make mutual authentication, and is 
verified as to whether it is eligible to play the contents 
recorded in the DVD 20 or not (step S101) . When the controller 
11 of the key storage unit 10 verifies that the DVD player 100 is 
eligible for playback and permits the DVD player 100 to read the 
contents key decoding key stored in the key storage 12 of the key 
storage unit 10 (step S102), the DVD player obtains the contents 
key decoding key from the key storage 12 and stores it in the 
contents key decoding key holder 102 (step S104). On the other 
hand, when the controller 11 of the key storage unit 10 does "not 
verify that the DVD player 100 is eligible for playback in step 
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S1Q1, the DVD player 100 is not permitted to read the contents 
key decoding key, and the process is halted m step S103- 

The DVD player 100, which has received the contents key 
decoding key, obtains the encrypted contents key 21 from the DVD 
20 by using the reader 104, and decodes the encrypted contents 
key 21 obtained from the DVD, with the contents key decoding key 
which has been stored in the contents key decoding key holder 102, 
by using the decoder 103, thereby obtaining the contents key 
(step S105) . Next, the DVD player 100 obtains the encrypted 
contents 22 using the reader 104, and decodes the encrypted 
consents 22 with the contents key which has been decoded by the 
contents key decoding key, by using the decoder 105, thereby 
obtaining plaintext contents . 

Thereafter, in step S1G7, the DVD player 100 plays' the 
obtained plaintext contents by using the player 106, and outputs 
a signal from the sxgnal output unit 107. While the contents in 
the DVD 20 are read and played by the reader 104 and the player 
106 which are controlled by the controller 101, the player 106 
continuously checks whether there is a change in the playback 
state of the DVD 20 (step S108), and when the playback state has 
changed, the player 106 posts the playback state to the- 
controller 101. When the controller 101 conforms that the 
playback state has become "STOP STATE", the controller 101 
instructs the contents key decoding key holder 102 to discard the 
contents key decoding key (step S109) , and the consecutive 
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operation is ended (step S110) . The "STOP STATE" indicates that 
the operation of the DVD player 100 is in the stopped state. 
When it is not confirmed that the playback state has become " STOP 
STATE" in step S108, the player 106 checks whether there is an 
instruction from the user (step Sill) - When there is no 
instruction from the user, the player 106 continues to monitor 
the playback state. When there is an instruction from the user, 
the player 106 operates according to the instruction of the user 
(step S112) . Step S112 is followed by step S108 to repeat the 
operation from checking the playback state. 

In the above-described operation, the DVD player 100 must be 
authenticated by the controller 11 of the external key storage 
unit 10 as to whether it is eligible to play the contents on the 
DVD 20 or not, every time it starts playback of the contents on 
the DVD 20 . 

Next, a description will be given of the case where the DVD 
player 100 is 3udged as being an illegal player in the mutual 
authentication between the key storage unit 10a and the DVD 
player 100, with reference to figure 3. 

Figure 3 is a block diagram illustrating key storage units, 
DVDs, and a DVD player in the case where the DVD layer is judged 
as being an illegal player. 

In figure 3, 10b denotes a key storage unit Mb different 
from the key storage unit MalOa. The key storage unit MblOb 
comprises a key storage 12a which contains a contents key 
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decoding key KKa which is identical to the contents key decoding 
key KKa stored in the key storage unit MalOa, and a controller 
lib which performs mutual authentication with the DVD player 100 
and permits the player 100 to read the contents key decoding key 
KKa. Further, 23 denotes a DVD Da containing an encrypted 
contents key 24 and encrypted contents 25, and 26 denotes a DVD 
Db containing contents other than those possessed by the DVD Da23 
More specifically, the DVD Db26 contains contents 28 encrypted by 
using a contents key Kb, and an encrypted contents key 27 
obtained by encrypting the contents key Kb by using the contents 
key decoding key KKa that is stored m the key storage 12a of the 
key storage unit MblOb. In figure 3, the same reference numerals 
as those shown in figure 1 denote the same or corresponding units 

In the DVD player 100, two DVDs Da23 and Db26, and two key 
storage units MalOa and MblOb which are constructed as described 
above, the key storage unit MalOa containing the contents key 
decoding key KKa is distributed together with the DVD Da23, and 
it is withdrawn at the appropriate time. The DVD player 100 
plays the contents 25 m the DVD Da23 by using the DVD Da23 and 
the key storage unit 10a. 

Now it is assumed that the DVD player 100 is judged as an 
illegal player for the reason that a pirated DVD copied with this 
DVD player 100 has been discovered. Further, it is assumed that 
the DVD Db26, which contains the contents encrypted with the 
contents key Kb encrypted with the contents key decoding key KKa 
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included in the key storage unit MblOb, is produced, and the 
contents key decoding key KKa is stored in the key storage unit 
MblOb to be distributed together with the DVD Db26. The key 
storage unit MblOb will be withdrawn at the appropriate time like 
the key storage unit MalOa. The controller lib in the key 
storage unit MblOb is altered so that it can recognize the DVD 
player 100 as an illegal player. Thereby, the key storage unit 
MblOb does not transmit the contents key decoding key KKa any 
more to the DVD player 100 which is judged as an illegal player 
while it transmits the key KKa to other normal DVD players (not 
shown) as ever . " - 

Thus, the DVD player 100 regarded as an illegal player 
cannot play DVDs which will be fabricated after the DVD Db2 6. 

As described above, according to the first embodiment, the 
contents key decoding key, which has been obtained- from the key 
storage 12 of the key storage unit 10 and stored in the contents 
key decoding key holder 102 of the DVD player 100, is discarded 
when the playback state becomes "STOP STATE" , and the contents 
key decoding key is not transmitted to the DVD player which is 
regarded as an illegal DVD player in mutual authentication 
between the key storage unit 10 and the DVD player. Thereby, the 
contents in the DVD is prevented from being played by the illegal 
DVD player. 

While in this first embodiment DVDs are used as digital 
media containing " encrypted contents, other digital media may be 
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used . 

Further, while in this first embodiment the DVD player 100 
requires two keys, the contents key decoding key and the contents 
key, for decoding the encrypted contents, it is not necessary to 
use two keys for encryption. Three or more keys may be used. for 
encryption, and one or more of them may be possessed by the key 
storage unit 10 outside the DVD player 100. Alternatively, one 
key may be used for encryption, and the key may be possessed by 
the external key storage unit 10. 

Further, while in this first embodiment the decoding . key 
obtained from the outside is discarded when the playback state of 
the DVD player 100 becomes "STOP STATE", the decoding key may be 
discarded according to any other playback state of the DVD 20. 
[Embodiment 2] 

Hereinafter, a second embodiment of the present invention 
corresponding to Claims 7 to 18, 21, 27 and 29 will be described 
with reference to figures 4 to 9 . 

Initially, a description will be given of a system including 
a data player and a key storage unit according to the second 
embodiment of the invention, with reference to figure 4. 

Figure 4 is a block diagram illustrating a system including 
a data player and a key storage unit according to the" second 
embodiment. The system shown in figure 4 comprises a key 
management unit 50 for generating a player key (decoding key) for 
each data player; a contents key encryption unit 51 for 
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encrypting a contents key by using the player key; a data 
encryption unit 52 for encrypting contents data to be recorded on 
a recording medium 30, by using the contents key; a key .storage 
unit 40 for storing the player key and permitting a "data player 
110 to read the player key; a recording medium (digital medium) 
30 containing the contents key 31 encrypted with the player key 
and contents 32 encrypted with the contents key 31; a data player 
110 for reading the player key from the key storage unit 40 and 
playing the encrypted contents 32 recorded on the recording 
medium 30; and a clock 53 for giving time data to the data player 
110. Preferably, the key storage unit 40 is implemented by a 
memory card with a CPU, such as a smart card. In this case, the 
key storage unit 40 and the data player 110 are connecLed through 
a memory card node and an IC card reader. 

Hereinafter, the internal structures of the key storage nit 
40 and the data player 110 will be described in more detail. , 

The key storage unit 40 comprises a controller 41 for 
controlling the key storage unit 40; a player key storage 
(decoding key storage) 42 for storing the player key fabricated 
by the key management unit 50; an available period storage 43 for 
storing the available period of the player key; a history data 
storage (key read history storage) 44 for storing' the read 
history when the player key is read from the key storage unit 40; 
a contents ID code storage 45 for storing the ID code, of the 
encrypted contents 32 recorded on the recording medium 30; a time 
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data storage 46 for storing the time data transmitted from the 
data player 110; a player ID code storage 48 tor storing the ID 
code of the storage unit 40; and a key-storage-to-player key 
storage 49 for storing a key used for encryption or decoding when 
performing encrypted communication between the key storage unit 
40 and the data player 110. 

The data player 110 comprises a controller 111 for 
controlling the data player 110; a player key storage 112 for 
storing the player key read from the key storage unit 40; a key 
decoding unit (decoding key obtaining unit) 113 for reading the 
encrypted contents key 31 from the recording medium 30 and 
decoding it; a playback unit (decoding unit) 114 for decoding and 
playing the encrypted contents data 32 included in the recording 
medium 30, by using the decoded contents key; a contents ID code 
storage 115 for storing the ID code of the encrypted contents 32 
in the recording medium 30; a key receipt time storage 116 for 
storing the time data from the clock 53; a player ID code storage 
(device ID code storage) 117 for storing the ID code of the data 
player 110; a key storage ID code storage 118 for storing the ID 
code of the key storage unit 40 from which the player key is 
read; a key-storage-to-player key storage 119 for storing a key 
used when performing encrypted communication between ^the key 
storage unit 40 and the data player 110; and a watermark 
embedding unit (data embedding unit) 120 for embedding an 
electronic watermark in the data played by the playback unit 114. 
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Next, the operation of the system including the data player 
110 and the key storage unit 40 will be described with respect to 
the process of recording the encrypted contents key 31 and the 
encrypted contents 32 on the recording medium 30 and -the process 
of playing the encrypted contents 32 on the recording medium 30, 

Figure 5 is a flowchart for explaining the operation of the 
system when playing the encrypted contents 32 on the recording 
medium 30 . 

Initially, a description will be given of the process of 
recording the encrypted contents key 31 and the encrypted 
contents 32 on the recording medium 30. 

In the key storage unit 40, the key management unit 50 
generates a player key of the data player 110, stores the player 
key in the player key storage 42, and writes the available period 
of the player key in the available period storage 43. Further, 
the key management unit 50 sends the player key and its available 
period (key read available period data) to a writer (not shown) 
which writes contents data such as a movie in the recording 
medium 30. The contents key used for encrypting the contents 
data in the data encryption unit 52 is encrypted with the player 
key in the key encryption unit 51. The encrypted contents data 
32 and the encrypted contents key 31 so obtained are recorded on 
the recording medium 30. In this way, there is generated the 
recording medium 30 containing the encrypted contents data 32 
obtained by encrypting the contents data with the contents key, 
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and the encrypted contents key 31 obtained by encrypting the 
contents key with the player key. Since these processes are 
performed when generating a movie title or the like of general 
DVD video, only the outlines of the processes are . described above. 
However, in order to realize distribution to plural data players, 
usually plural contents keys encrypted with plural player- keys 
corresponding to the plural destinations (data players) .are 
recorded (not shown) . 

Next, a descriptxon will be given of the operations of the 
key storage unit 40 and the data player 110 when playing the 
encrypted contents data 32 on the recording medium 30 so obtained, 
according to the flowchart of figure 5. 

When the recording medium 30 is played by the data player 
110, initially, the controller 111 reads the contents ID code of 
the recording medium 30 and stores it in the contents ID code 
storage 115 (step S201) . Then, in step S202, the controller 111 
takes the present time data from the clock 52 and stores it as 
the key read time in the time data storage 116. Next, in step 
S203, a key request command (a signal requesting the player key) 
is transmitted together with the key read time stored in the -time 
data storage 116, the contents ID code stored in the contents ID 
code storage 115, and the player ID code (device TD.code) of the 
data player 110 which is stored in the player ID code storage 117, 
to the controller 41 of the key storage unit 40. These data to 
be transmitted between the controller 111 of the data player 110 



3 3 



and the controller 41 of the key storage unit 40 are encrypted 
with the key-storage-to-player key which xs common to the both 
units and stored in the key-storage-to-player key storages - 49 - and 
119. Further, decoding of the encrypted data can be performed 
software-wise in the controllers 41 and 111. 

Next, the controller 41 of the key storage unit 40 stores 
the key read time, the contents ID code, and the player ID code, 
which have been transmitted from the data player 110, in the time 
data storage 46, the contents ID code storage 45, and the player 
ID code storage 47, respectively. In step S204, the latest time 
which has already been stored in the history data storage 44 is 
compared with the key read time stored in the time data storage 
46. When the key read time is later than the latest time, it is 

decided that the process has succeeded. Otherwise, playback of 
the recording medium 30 is immediately stopped by issuing a 
process stop message or the like to the data player 110 m step 
S205. 

Next, in step S206, the controller 41 confirms as to whether 
the key read time is within the available period of the player 
key which is stored in the available time storage 43. When the 
key read time is within the available period, it is decided that 
the process has succeeded. Otherwise, playback is immediately 
stopped in step S205. Then, in step S207, those data stored in 
the time data storage 46, the contents ID code storage 45, and 
the player ID code storage 47 are recorded as the history data in 



34 



the history data storage 44. If writing of these data fails, the 
control returns to step S205 to stop the playback immediately. 

When the three processes in steps S204, 5206, and S207 have 
succeeded, the control proceeds to step S208 wherein the 
controller 41 of the key storage unit 40 transmits the player key 
stored in the player key storage 42 to the controller 111 of the 
data player 110, together with the key storage ID code of the key 
storage unit 40 which is stored in the key storage ID- code 
storage 48. In step S209, the controller 111 takes the player 
key from the key storage unit 40, and stores the player key in 
the player key storage 112, and the key storage ID code of the 
key storage unit 40 in the key storage ID code storage 118. 

In the data player 110, the player key so obtained from the 
key storage unit 40 is input to the key decoding unit 113. In 
step S210, the controller 111 reads the encrypted contents "key 31 
from the recording medium 30. In step S211, the encrypted 
contents key 31 is decoded to obtain the contents key. This 
contents key is input to the playback unit 114. In step S212, 
the controller 111 reads the encrypted contents data 32 from the 
recording medium 30, and the encrypted contents data 32 is . 
decoded using the contents key. Thereafter, in step S213, 
playback is carried out according to the contents of data. That 
is, when the data to be played is video data compressed in MP EG 2 
format, the video data is decoded by MPEG2 decoding to transform 
the data to a video signal. Thereafter, in step S214, the player 
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ID code, the key storage ID code, or the key xead time (the time 
at which the player key read request was made) which are stored 
in the player ID code storage 117, the key storage ID coded 
storage 118, and the time data storage 116, respectively, is 
embedded as a watermark in the data output from the playback unit 
114 by the watermark embedding unit 120, and the watermark- 
embedded data is output to the outside of the data player 110. 

After playback of the contents data from the .recording 
medium 30 is completed, in step S215 the controller 111 of the 
data player 110 transmits an end-of -key-use time at which use of 
the player key is ended, from the clock 53 to the controller 41 
of the key storage unit 40. In step S216, the controller 41 of 
the key storage unit 40 stores the end-of - key-use time in the 
history data storage unit 44, whereby playback is ended. 

Hereinafter, the process of writing the history data (steps 
S207 and S216) will be described in more detail with reference to 
figures 6 and 7 . 

Figure 6 is a table showing an example of history "data 
written in the history data storage 44, and figure 7 is a 
flowchart for explaining the process of writing the history data. 
In the first row of the table of figure 6, the start time of the 
available period of the key has already been written. 

Initially, in step S302, writing of the key.nonuse period is 
performed as follows. That is, in the first column of the row 
next to the last 'row which has been written most recently, a 
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difference between the time data in the leftmost column of the 
last row and the key read time (the time at which the player key 
was requested) which is stored in the time data storage 46* is 
written as the key nonuse period. In the second column of the 
same row, the time data in the leftmost column of the last row is 
written. In the third column of the same row, the key read time 
is written. Then, hashing is carried out to detect alteration on 
the data in the just written row and in the previous row, and the 
! result is written in the fourth column. 

{ Next, in step S303, writing of the start time (start time 1) 

I is performed as follows. That is, in the row next to the row 
I which has been written in step S302, the key read time is written 
J in the first column, the player ID code is written in the second 
J column, and the- contents ID code is written in the third column. 
Thereafter, hashing is carried out to detect alteration on the 
data in the just written row and in the previous row, and the 
result is written in the fourth column. 

Thereafter, as already described with respect to steps S215 
and S216 in figure 5, the controller 111 of the data player 110 
transmits the time data obtained from the clock 53, as a signal 
indicating that the use of the player key is ended, to the key 
storage unit 40. On receipt of the time data, in step S3G4, the 
controller 41 of the key storage unit 40 writes the end-of-key- 
use time in the row next to the row which has been written in 
step S303. More specifically, the end-of -key-use time supplied 
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from the data player 110 is written in the first column, the 
player ID code is written in the second column, and the contents 
ID code is written in the third column, and furthermore, hashing 
is performed to detect alteration on the data in the -just written 
row and in the previous row, and the result is written in the 
fourth column . 

According to the process steps described above, every time 
the history data is written, it is connected with the previous 
history data by the alteration detection code. So, even when 
illegal history data is inserted in the history data shown in 
figure 6, the position of the illegal UisLory data can be easily 
detected as long as the method of generating the alteration 
detection code is not discovered. Further, the latest time data 
is written in the first column in the last row of the written 
history data, and the following time data is always later than 
this time. Otherwise, the process is stopped and no key is 
distributed as described with respect to step S204 in- figure 5, 
whereby the illegality of setting the time data backward is 
avoided . 

Further, when the end-of-key-use time is also written as the 
history data in addition to the player key read time, the time of 
the clock 53 can be advanced by at least the playback time. 

Further, the capacity of the history data storage 44 of the 
key storage unit 40 may be limited. In this case, when the - 
storage 44 is filled up with the history data, since no' more ' 
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history data is written in the storage 44, it is decided that the 
process fails and the key distribution is stopped as described 
for step S207 in figure 5. Therefore, the upper bound of the 
number of key receipt times can be set by limiting the storage 
capacity . 

Next, a description will be given of the watermark embedding 
method (step S214 in figure 5) and a method for detecting the 
embedded watermark, with reference to figures 8 to 10. 

Figure 8 is a diagram for explaining the structure of the 
watermark embedding unit 120 and the structure of a watermark 
detection unit. Figure 9 is a diagram for explaining pattern 
sequences embedded in frames as the result of the watermark 
embedding process. Fxgure 10 is a diagram for explaining the 
case where the history data written as shown in figure 6 is used 
for reading the embedded data. 

Initially, the structure of the watermark embedding unit 120 
will be described with reference to figure 8. 

In figure 8, a sequence generator 121 converts ddla Lo be 
embedded into a pattern sequence to be embedded in video frames. 
A watermark embedding unit 122 embeds the pattern sequence 
generated by the sequence generator 121, frame by frame, thereby 
converting the input data to watermark-embedded data.- Further, 
watermark detector 125 detects the pattern embedded in the frames 
by the watermark embedding unit 122. A watermark short-period 
embedded pattern detector 123 and a watermark long-period 
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embedded pattern detector 124 detect the embedded data from the 
pattern detected by the watermark detector 125. 

The operation of the watermark embedding unit will- be 
described with reference to figures 8 and 9. As a pattern to be 
embedded, a bit pattern including the player ID code of the data 
player 110, the storage ID code of the key storage Unit 40, or 
the time data is inputted to the sequence generator 121. In the 
sequence generator 121, the inputted bit pattern is converted to 
a pattern sequence to be embedded frame by frame, and transmitted 
to the watermark -embedding unit 122, More specifically, in the 
sequence generator 121, the inputted bit pattern is divided into 
plural patterns according to the number of bits to be embedded in 
each frame, thereby providing plural patterns to be embedded in 
the respective frames. For example, in the case where the bit 
pattern to be embedded has 8 bytes and this pattern is to be 
embedded by 4 bits per frame as shown in figure 9, when the 
pattern to be embedded is "0110010111001010", "65ca" based on 
hexadecimal is embedded in the first four frames. Next, the 
first bit value "0" of the embedded pattern is input to the same 
number of frames as described above. That is, the first bit 
value of the embedded pattern is embedded for a period equivalent 
to the frame length as long as the previously embedded pattern. 
For example, when the value to be embedded is "0", "0" is output 
for a period of 4 frames. When it is "1", "FFFF" based on 
hexadecimal is output for a period of 4 frames. Next, the 
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initially embedded pattern "65Ca" is embedded again and then the 
second bit value of the embedded pattern xs embedded. In this 
way, sequentially embedding the pattern to be embedded in a 
predetermined number of frames, and embedding only one bit of the 
embedded pattern m the same number of frames, are alternately 
repeated. 

The watermark detector 125 detects the embedded pattern 
frame by frame. While in this second embodiment the original 
image is used as a reference image, the original image is not 
referred to when an embedding method that can detect the embedded 
pattern without referring to the original image is employed. The 
result of the frame-by-frame detection of the embedded pattern is 
transmitted to the short-period embedded pattern detector 123 and 
the long-period embedded pattern detector 124. The short-period 
embedded pattern detector 123 repeatedly compares the results of 
detection on the bit sequences embedded in short periods to 
detect, for each bit, the bit value which appears most frequently. 
The long-period embedded pattern detector 124 obtains the result 
of detection in the period of embedding each bit, for example, 
whether all of the bits in the frames from the fifth frame to the 
eighth frame are "1" or "0'\ When all of the detected values are 
not equal, the bit value ("1" or "0") detected in larger number 
is selected. 

In the above-described short-period embedded pattern 
detection, the embedded data can be decoded with a small number 
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of frames. On the other hand, in the long-period embedded 
pattern detection, since bit-by-bit detection is carried out over 
a long period, correct values can be obtained by majority 
decision even when some watermarkb are altered, whereby the 
embedded patterns can be obtained by performing bit-by-bit 
detection for all of the embedded patterns-. 

When data is embedded in short periods, since the embedded 
data appears in every several frames in the video, the embedded 
data can be detected even when the video data is edited, but this 
method is not resistant to alteration such as frame Extraction- 
On the other hand, when data is embedded over a long period, the 
embedded pattern cannot be detected unless the video data is 
detected for the long period, but this method is resistant to 
alteration such as frame extraction. Therefore, by using the two 
embedding methods together, an embedding method resistant to 
alteration and edition is realized by compensating each other's 
weak point . 

The manner of using the short-period embedding method and 
the long-period embedding method together is not restricted to 
that described for the second embodiment. For example, assuming 
that four bits are embedded in one frame, three bits of them may 
be used for short-period embedding while using the remaining one 
bit for the long-period embedding. 

Next, a description will be given of the case, where "the 
history data written as shown in figure 6 is utilised for reading 
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embedded data as mentioned above, with reference to figure 10. 

Figure 10 is a diagram illustrating the consLiuction of a 
device for specifying an illegal player, an illegal key storage 
unit, or the time at which an illegal act was carried out. 

In figure 10, 60 denotes an illegally copied recording 
medium/ and 131 denotes a watermark detector comprising, for 
example, the watermark detector 125, the long-period embedded 
pattern detector 123, and the short-period embedded pattern 
detector 124 shown in figure 7. Further, 132 denotes a 
retrieve/verification process according to the player ID code of 
the data player 110, 133 denotes a retrieve/verification process 
according to the key storage ID code of the key storage unit 40, 
and 134 denotes a retrieve/verification process according to the 
key read time data. 

There is the possibility that the embedded data detected by 
the watermark detector 131 could have been altered by an illegal 
user. That is, it is supposed that the illegal user has tried to 
delete or alter the embedded data to escape from pursuit 
according to the embedded data. As the result, the original data 
may be defected by removing the embedded part, or part of the 
data may be wrongly detected due to alteration by embedding 
random data in the origina3 data. As long as at least one of the 
embedded data is detected correctly, the remaining data can be 
restored by retrieving the history data base wherein the history 
data withdrawn from the history data storage 44 of the key 
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storage unit 40 is stored. That is, in the retrieve/verification 
processes 132, 133, and 134 according to the player ID code, the 
key storage ID code, and the key read time, respectively , each 
data can be used to restore the remaining data. Further, the 
illegal player or key storage unit or the time when the illegal 
act was done can be estimated with fairly high probability by 
putting these data together and detecting one having the highest 
correlation with any of them, from the history data. 

As described above, according to Lhe data player 110 of this 
second embodiment, the player key read history is stored in the 
key storage unit 40. Therefore, even when someone tries to make 
a false declaration of the present time in confirming the 
available period or the like, since the time to receive the 
player key is always in the clock advancing direction, the 
illegal user cannot play the data over the playback time in which 
the data is continuously played. 

Further, since the capacity of the history data storage 44 
of the key storage unit 40 is limited, any player cannot obtain 
the key exceeding the capacity, whereby the upper bound of the 
number of illegal acts can be set. 

Further, writing of history which cannot be easily altered 
is realized by giving hash values to the history; 

Furthermore, according to the second embodiment, the 
precision in detecting the embedded data can be increased with 
the history dala written in the history data storage AA of the 
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key storage unit 40. Further, collation of the history data with 
the detected embedded data can provide certain evidence of 
illegality. 

Moreover, since two data embedding patterns, ; i.e., the _ 
short-period pattern and the long-period pattern, are -used 
together, a data embedding method resistant to alteration is 
realized . 

In this second embodiment, the key's available period and 
the like are checked when the key storage unit 40 reads the key. 
However, as long as the data player 110 is guaranteed for anti- 
tamper characteristics and is not modified, the data player 110 
may receive the key data and the history data by encrypted 
communication from the key storage unit 40 to check the available 
period and the like on the basis of these data. In this case, 
also the history data may be generated in the data player 110 and 
transmitted to the key storage unit 40 by encrypted communication 

to be stored therein. 

Further, when the time data is taken from the history data 
in checking the previous access time in step S205 of figure 5, it 
may be checked using the hash values shown in figure 6 as to 
whether the history data itself was altered or not,' whereby the 
higher safety is achieved. That is, alteration check is realized 
by performing the same process as calculating the hash value from 
the history data and then checking whether the result matches the 
hash value or not. 
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Further, m this second embodiment, when writing the history 
data, the completely continuous history data, i.e., the player 
key read request time, the end-of -key-use time, and the key 
nonuse period. However, even when only the access time to the 
key is written, the feature of the xnvention that the time data 
is advanced only in the clock forward direction is maintained and, 
therefore, the effects of the present invention are' maintained. 
[Embodiment 3] 

Hereinafter, a third embodiment of the present invention 
corresponding to Claims 19 to 26, and 28 will be described with 
reference to figures 11 and 12. 

Initially, the process of embedding data in a video/audio 
signal will be described with reference to figure 11. 

Figure 11 is a block diagram illustrating a data embedding 
apparatus according to the third embodiment of the invention. In 
figure 11, 220 denotes a data embedding means, 221 denotes a real 
time measuring means, 222 denotes a real position measuring means, 
and 223 denotes an ID storage means. 

Next, the operation of the data embedding means so 
constructed will be described. 

The data embedding means 220, to which a video/audio signal 
is input, embeds the following data in the video/audio signal: ID 
data for identifying a device, which is output from the ID - 
storage means 223; real time data for specifying the present time, 
which is output from the real time measuring means 221; and real 
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position data for specifying the present physical position, which 
is output from the real position measuring means 222. Thereafter, 
the data embedding means 220 outputs the data-embedded 
video/audio signal. The video/audio signal to be input to the 
data embedding means 220 is an analog or digital video signal ' or 
an analog or digital audio signal, and this signal is in the 
visible or audible state. 

Hereinafter, the functions of the respective constituents 
will be described in detail. 

As the real time measuring means 221, means having an 
arbitrary construction capable of outputting real time data which 
specifies the present time, can be used. For example, it is 
implemented by a clock or a counter. As the real time data, 
"year, month, date (day of month) , hour, and minute' 1 based on 
Greenwich Mean Time (English standard time) may be used. Of 
course, the standard time of any country may be selected. 
Further, the range of the real time data may be selected 
according to a request or use, such as "year, month, and date", 
"year and month", "year, month, date, and hour", or "year, month, 
date, hour, minute, and second". Further, the real time data is 
not limited to data representing the general time as" described 
above. Any data may be used as long as it can specify the time 
where data was embedded. For example, based on specific date and 
time (e.g., January 1, 2000, 12 o'clock midnight (00:00)), the 
real time data may be represented by some minutes or some hours 
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from this date and time. When the real time measuring means 221 
is applied to a system that can record the history of processing 
(in this case, playback) such as an electronic cinema, the real 
time data may be represented by the number of processing times. 

Next, the real position measuring means 222 has an arbitrary 
construction which can measure its physical position to output 
real position data for specifying this position, such as a GPS 
(Global Positioning System) . As the real position data, data in 
an arbitrary form which can specify a physical position, such as 
a combination of the latitude and the longitude, may be used. 

To implement the real position measuring means 222, there is 
a method of measuring its physical position on the basis of a 
position reference signal supplied from the outside, and 
outputting it as real position data. As a typical example of 
this, there is a method according to the GPS. The GPS receives 
waves from plural navigation satellites with an antenna, 
calculates the distances from it to the satellites according to 
the arrival times of the waves by using a real position measuring 
means, and measures its position from the distances. The GPS has 
been practically used for a car navigation system or the like. 
As another example, there is a method according to* GLONASS 
(Global Navigation Satellite System) using the same principle as 
that of the GPS.- Further, there is another example according to 
DGPS (Differential GPS ) . The DGPS receives GPS compensation data 
through a FM wave and compensates the position according .to the 
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GPS, in addition to the operation of the GPS. Further, there is 
still another example according to PHS (Personal Handy Phone) 
measurement . The PHS measurement receives waves from three PHS 
base stations of higher field intensities, and measures its 
position on the "basis of the positions of the base stations and 
the field intensities of the received signals . 

The real position measuring means 222 is implemented by any 
of the above-mentioned examples or a combination of them. 
However, the present invention is not restricted thereto. The 
real position measuring means 222 can be implemented by an 
arbitrary construction which receives, with an antenna , signals 
from plural satellites or fixed stations as reference position 
signals, and measures its physical position according to the 
reference position signals. As a method for measuring the 
physical position, there is an arbitrary means for calculating 
the position from the arrival times or intensities of waves from, 
the outside. Further, the real position measuring' means 222 may 
be combined with means for obtaining its precise position by* 
using data for compensation which has been received separately 
through broadcasting, or data about the travel distance or 
direction of a mobile body such as a car or an airplane on which 
the real position measuring means 222 is mounted, or a map. 
Further, means for directly receiving position data from the 
server, or a combination of these means, may be us.ed as long as 
the real position measuring means 222 can measure its physical 
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position. 

The data embedding means 220 has an arbitrary construction 
for embedding the ID data, the real time data, and the real 
position data in a video/audio signal. This means is implemented 
by an arbitrary method for embedding data and, thereafter, 
detecting the embedded data. For example, assuming that the 
signal output from the decoding means 230 is a video signal, -data 
can be multiplexed in the blanking period of the video signal. 
Further, an arbitrary means for embedding data in video or audio, 
which is known as watermarking, may be used. 

Hereinafter, a data embedding method using watermarking will 

be described. 

The data embedding method using watermarking may employ 
replacement of pixels corresponding to data to be embedded. In 
this method, initially, at least one pixel is selected from each 
frame of video, based on the data to be embedded. For example, a 
number is calculated from the data, and a pixel in the position 
indicated by the number is selected. Next, the data of the 
selected pixel is replaced with the data calculated from the data 
of an adjacent pixel. When detecting the data, the replaced 
pixel can be detected by comparing the image in which the data is 
embedded with the image in which no data is embedded, i.e., the 
original image decoded from the stream. The data can be restored 
from the position of the detected pixel. 

Another example of watermarking is described in, for example, 
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"Data Hiding Technique Supporting Watermarking", pp.l49~162, 
Nikkei Electronics, February 24, 1997 (No. 683), and "Techniques 
for Data Hiding", written by W. Bender, D.Gruhl, N.Morimoto, A.Lu, 
IBM Systems Journal, Vol.35, Nos.3&4, 1996. In this method, two 
pixels (Ai,Bi) are selected from video by pseudo random "numbers , 
and when the bit to be embedded is "1", the luminance level Yai 
of Ai is raised by d while the luminance level Ybi of Bi is 
lowered by d. Inversely, when the bit to be embedded is "0", the 
luminance level of Ai is lowered by d while the luminance level 
of Bi is raised by d. The value of d is an integer from 1 to 5 . 
By repeating these processed n times (usually, n is about 10,000), 
data is embedded in the video. When detecting the embedded data, 
two luminance levels in the same positions as described for the 
data embedding process, i.e., (Yai+d, Ybi-d) or ( Yai-d, Ybi-fd) , are 
extracted from the video by the pseudo random numbers, and a 
difference between these points is calculated. These processes 
are repeated for each position by n times, and the average of the 
differences is obtained and, thereafter, it is decided that the 
embedded bit is "0" or "1" according to that the average is near 
to +2d or -2d. 

Besides the methods mentioned above, there are various kinds 
of data embedding methods, and an arbitrary method may be 
employed . 

Next, the process of detecting the embedded "data will be 
described with reference to figure 12. 
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Figure 12 is a block diagram illustrating an example of a 
construction for detecting embedded data, and specifying a data 
player used for an illegal act or an operator of the player. 

When the video/audio signal including data embedded by the 
data embedding means 220 is illegally used, the embedded data is 
used for specifying the illegal player including the data 
embedding means 220 and its operator. Here, "illegal use" means 
to use the video/audio signal played by the player, for copying, 
retransmission, or edition without permission. 

In figure 12, reference numeral 280 denotes a data detection 
means, 281 denotes a collation means, and 202 denotes a data base* 
The data detection means 280 detects at least one of the ID data, 
the real time data, and the real position data which are embedded 
in the video/audio signal, and outputs* the data. To be specific, 
the data detection means 280 detects the data embedded by the 
data embedding means 220 from difference data obtained by 
comparing the input video/audio signal with the video/audio 
signal in which the data has not yet been embedded. The 
detection method is not restricted to the above-mentioned one, 
and any method corresponding to the embedding process by the data 
embedding means 220 may be employed. For example, embedded data 
can be directly detected from a video signal in which the data is 
embedded in the blanking period. Further, when data is embedded 
in a video/audio signal by watermarking, the embedded data can be 
detected by comparing the data-embedded video/audio signal with 
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the video/audio signal in which the data has not yet been 
embedded. From these detected data, you can know the ID data of 
the player used for playback, the time when playback was carried 
out, and the physical position where playback was carried out. 
These data can be used for investigating the illegal player and 
its operator from the illegally used video/audio signal. 

Further, in the data base 202, the ID of the operator of the 
player may be written in association with the ID data of the 
player, the time of the operation, and the place of the operation. 
In this case, the operator ID can be specified by the collation 
means 281. Such data base can be created according to reports 
from managers of -data players in systems the operators of which 
can be specified, such as AV systems in electronic movie theaters 
or airplanes. The data base 282 and the collation means 281 can 
specify the operator more easily in a system which can construct 
the data base 282. 

As described above, according to the third embodiment of the 
present invention, by mounting or using the data embedding mfeans 
220 on or together with a video/audio signal player, recorder, or 
editor, the device used for the process {i.e., playback, 
recording, or edition) and the time and place can be specified. 
Therefore, when the video/audio signal is illegally processed, 
the illegal use can be detected, i.e., the illegally used player 
and the time and place of the illegal use can be specified. For 
example, it is assumed that the data embedding means 220 is - 
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mounted on a data player, and data is embedded in a signal played 
by the data player. In this case, when the video/audio signal 
played by the data player is illegally recorded on a recording 
medium, the player which played the video/audio signal, the time, 
and the place can be specified from the recorded video/audio 
signal, whereby the illegal user is specified and further illegal 
use can be prevented. 

Furthermore, according to the third embodiment, "since the 
data for specifying the illegal person can be detected as well, 
the effect of dissuading people thinking of doing illegal acts is 
also expected . 

While in this third embodiment the ID data, the real time 
data, and the real position data are multiplexed in the 
video/audio signal, the real position measuring means 222 may be 
dispensed with and only the ID data and the real time data" may be 
multiplexed. In this case, the player and the time by/at which 
playback was performed can be detected. Alternatively, the real 
time measuring means 221 may be dispensed with and only the ID 
data and the real position data may be multiplexed. In this case, 
the player and the place by/in which playback was- performed can 
be detected. Further, only the real position data may be 
multiplexed. Tn this case, only the place where playback .was 
performed can be detected. 

Furthermore, while in this third embodiment a video/audio 
signal is adopted as the object of processing, the object may be 
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only a video signal or an audio signal. Further, the object may 
be a video or audio signal compressed by MPEG. Furthermore, the 
object may be data of text or program. Also in these cases, the 
same effects as described above are achieved. 

The ID storage means 223 may be implemented by a removable 
device such as an TC card, with the same effects as described 
above . 

Further, while in this third embodiment data which can 
specify a device is used as ID data, data which can specify a 
company or a place relating to a device may be used as ID data, 
for example, a manufacturer of the device, a carrier using the 
device, a mobile body (airplane, bus, etc.) in which the device 
is used, a hall or movie theater in which the device" is used. 
Alternatively, the ID of the user of the device may be used as ID 
data. The user ID may be stored in the ID storage means 223, or 
it may be input through an input means such as a keyboard or a 
remote controller. As described above, as ID data, any data for 
identifying a device itself, a carrier or place relating to the 
device, or a user of the device, may be employed, with the same 
effects as described above. Of course, a combination of these 
data may be used. 

Further, while in this third embodiment the data embedding 
apparatus embeds the ID data, the real time data, and the real 
position data, the apparatus may be constructed so -that it embeds 
arbitrary data relating to a device, person, company, or place 
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by/in which the processing was performed, with the same effects 

as described above. 

While the data embedding apparatus of this third embodiment 
is constructed as shown in figure 11, it can be implemented by an 
arbitrary construction that performs the same operation as 
mentioned above. It is also possible to implement the data 
embedding apparatus by a combination of a CPU or processor with a 
program, which realizes the process of embedding some or all of 
the ID data, the real position data, and the real time data in a 
video/audio signal . 

Further, the data embedding apparatus may be constructed so 
that the ID data, the real time data, and the real position data 
are encrypted when being embedded, and decoded when being 
detected. This construction makes alteration of these data 
difficult. Further, an arbitrary encryption technique such as 
authentication or signature makes alteration more difficult. 
[Embodiment 4] 

Hereinafter, a fourth embodiment of the present invention 
corresponding to Claims 30 and 32 will be described with 
reference to figures 13 and 14. 

Figure 13 is a block diagram illustrating a playback system 
according to the fourth embodiment- In figure 13, 200 denotes a 
data player, 220- denotes a data embedding means, 210 denotes a 
control means for controlling the data player 200, 221 denotes a 
real time measuring means, 222 denotes a real position measuring 
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means, 240 denotes a stream output unit (data output means), 230 
denotes a decoding means for decoding data outputted from the 
stream output unit 240. - ' 

The stream output unit 240 outputs a stream like an MPEG-TS 
(Moving Picture Expert Group - Transport Stream) which is 
recorded on a recording medium or received by broadcasting. This 
stream is encrypted, and a key used for encryption is also 
encrypted and multiplexed in the stream. Since the data 
embeddxng means 220, the real time measuring means 221, and the 
real position measuring means 222 operate in the same way as 
described for the third embodiment and, therefore, repeated 
description is not necessary. 

The operation of the playback system so constructed will be 

described hereinafter. 

A stream outputted from the stream output unit 24 0 is input 
to the data player 200 and decoded by the decoding means 230. 
The decoding means 230 separates the encrypted key from the 
stream and outputs it. The encrypted key is decoded by the 
control means 210 and inputted to the decoding means 230 again. 
The decoding means 230 decodes the stream by using the key. 
Further, the decoding means 230 decodes the stream to obtain a 
visible/audible signal. That is, the decoding means 230 performs 
demultiplexing of the multiplexed stream, and decompression of 
the compressed stream to convert it into a visible/audible signal. 
The signal outputted from the decoding means 230 is input to 



57 



the data embedding means 220. In the data embedding means 220 r 
the ID data outputted from the control means 210, the real time 
data outputted from the real time measuring means 221, and the 
real position data outputted from the real position measuring 
means 222 are embedded in the input signal. The ID data is a 
device ID for specifying the data player 200. 

As described above, in the signal played by the data player 
200, the following data are embedded: the ID data for specifying 
the player 200, the real time data for specifying the time when 
the signal was played, and the real position data for specifying 
the place where the signal was played, and these data are 
detectable. Accordingly, when a recording medium, on which the 
signal played by the data player 200 is recorded without 
permission, is illegally sold or distributed, it is possible to 
specify the device, time, and place of the illegal recording, 
from the signal recorded on the recording medium. 

Accordingly, further illegal acts can be avoided by 
utilizing the data of the specified device, time, and place. 

To facilitate understanding, how the illegality is detected 
or avoided will be described hereinafter. 

It is assumed that the playback system of this fourth 
embodiment is used for playing a movie on a mobile body such as 
an airplane or a bus. As an example of illegality, it is- 
supposed that the movie is copied without permission by a working 
stuff or a passenger. In this case, the playback system of this 
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fourth embodiment can specify the data of the device, time, and 
place of the illegal copying, from the illegally copied 
video/audio signal. Furthermore, it is possible to mark down the 
person who illegally copied the movie, according to the specified 
data and the boarding list of working stuffs and passengers. - It 
is supposed that, as another example of illegality, someone 
carries out the playback system without permission and then 
performs illegal copying. In this case, the device carried out 
and used for the illegal copying, and the time and place 
when/where the illegal copying was performed, can. be specified. 
Even when illegal copying is performed in an individual home, the 
device or the home by/in which the illegal copying was carried 
out . 

Furthermore, the playback system of this fourth' embodiment 
can detect the data which specifies a person who did an illegal 
act, and this will dissuade a person thinking of doing an illegal 
act from doing it actually. 

While in this fourth embodiment the stream output unit 2 40 
outputs an MPEG-ST, the stream output unit is not restricted 
thereto. Hereinafter, another example of the stream output unit 
240 will be described. 

The stream output unit 240 is an arbitrary device for 
outputting a digitized video signal, an audio signal, data, or a 
stream in which these are multiplexed. Further, the stream is a 
digital signal of an arbitrary format including video, audio, 
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data, and the like. Examples of stream formats are as follows: 
MPEG1 video, Layer I, Layer II, or Layer III (generally called as 
MP3) audio, MPEG2 video, BC or AAC audio, and Dolby-AC3 audio. 
Further, there die MPEG2-TS and MPEG2-PS (program stream) 
obtained by multiplexing them. Further, there are MPEG4 video, 
TwinVQ audio, and DV format video or audio. Furthermore, the 
stream output unit 240 can output analog video or -audio and, of 
course, an arbitrary format may be used. 

Examples of the data output unit 240 for outputting the 
above-described streams are as follows: a digital broadcast tuner 
which receives a signal of satellite broadcasting or ground-wave 
broadcasting which is transmitted in a radio wave, and plays a 
stream from the received signal; a digital broadcast tuner which 
receives a signal of a cable TV transmitted through a cable such 
as a coaxial cable or an optical fiber, a retransmitted signal of 
satellite broadcasting or ground-wave broadcasting, or a signal 
of wire broadcasting, and plays a stream from the received 
signal; a data player which plays a stream from a signal recorded 
on recording media, for example, an optical disk such as a DVD or 
a CD (compact disk), a magneto-optical disk, a magnetic disk, a 
tape such as a digital VHS or DV, a hard disk, and a solid 
memory; a receiver which receives a signal transmitted through a 
telephone line, Ethernet, or a network such as ATM, and plays a 
stream from the received signal; and a PC (personal computer) or 
a processor which realizes the above-described functions. Of 
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course, the data output unit 240 is not restricted to those 
examples mentioned above, and an arbitrary device which outputs a 
stream may be used. 

As described above, the stream output unit 240 may have an 
arbitrary construction which outputs an arbitrary stream. In 
this case, the decoding means 230 has an arbitrary construction 
which can decode the stream outputted from the stream output unit 
240. 

While in this fourth embodiment an encrypted stream and its 
key are multiplexed when being output from the stream output unit 
240, the present invention is not restricted thereto. For 
example, when encryption is performed using a key stored in the 
control means 210, this key is not necessarily multiplexed' in the 
stream. Further, an unencrypted stream may be output from the 
stream output unit 240. In these cases, the control means 210 
realizes only the process required for each case. 

Further, while in this fourth embodiment the stream output 
unit 240 and the data player 200 are connected by one-to-one 
correspondence, a stream outputted from one stream output unit 
240 may be played by plural data players 201, 202, and 203 as 
shown in figure 14. The number of data players is not restricted 
to three. 

Further, the control means 210 may be implemented by a 
removable device such as an IC card, with the same effects as 
described above. 
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While in this fourth embodiment the ID data is outputted 
from the control means 210, the data player 200 may 'have an ID 
storage means with the same effects as described above. 

While in this fourth embodiment the data player 200 has both 
of the real time measuring means 221 and the real position 
measuring means 222, one of these means may be dispensed with. 
[Embodiment 5] 

Hereinafter, a fifth embodiment of the present invention 
corresponding to Claims 31 and 33 will be described -with 
reference to figures 15 to 17 . 

Initially, the construction of a playback system according 
to this fifth embodiment will be described with reference to 
figure 15. 

Figure 15 is a block diagram illustrating an example of a 
playback system according to the fifth embodiment. In figure 15, 
204, 205, and 206 denote data players, 241, 242, and 243 denote 
stream output units, 221 denotes a real time measuring means, and 
222 denotes a real position measuring means. 

In this fifth embodiment, the real time measuring means 221 
and the real position measuring means 222 are identical to those 
described for the third embodiment, and the stream output units 
241, 242, and 243 have the same construction as that of the 
stream output unit 240 according to the fourth embodiment. 

Further, each of the data players 204, 205, and 20& 
according to this fifth embodiment is different from the data 
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player 200 according to the fourth embodiment only in that it 
does not include the real time measuring means 221. and the real 
position measuring means 222, and receives real time data and 
real position data supplied from the outside. 

The playback system so constructed provides the same effects 
as those provided by the playback system of the fourth embodiment. 
In addition, the number of the real time measuring means 221 and 
the real position measuring means 222 can be reduced, and the 
precision of real time data or real position data is prevented 
"from varying amongst the data players . 

Further, when each of the data players 204, 205, and 206 is 
constructed so that it performs playback only when correct real 
time data and correct real position data are input, undesired 
illegality or malfunction such that playback is performed without 
embedding the real time data and the real position data, is 
avoided . 

Thereby, when the stream output units 241-243 and the data 
players 204 — 206 are stolen, playback by the stolen units is 
avoided. For example, when these units are lent to seats of an 
airplane ox a bus, the respective units are set so that they 
perform playback only when the signals from the real time 
measuring means 221 and the real position measuring means 222 are 
supplied. Thereby, even when the lent units are carried out, 
these units cannot be used for playback, whereby illegal playback 
is avoided. 
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A method for controlling the data players 204, 20S, and 206 
so as to operate only when correct real time data and correct 
real position data are input, is implemented by an arbitrary 
construction. The simplest method is to make each data player 
perform playback only when the real time data and the real 
position data are input. Further, in order to increase the 
security, there is a method of adding error correction codes or 
encrypted signatures to the real time data and the real position 
data, or a method of performing encrypted authentication. 
Further, the security is also increased by a method of 
transmitting key data for decoding the stream, together with the 
real time data and the real position data. Further, these 
controls may be performed by the controlling means -of the data 
player . 

Next, another example of a playback system according to the 
fifth embodiment will be described with reference to ^figure 16. 

Figure 16 is a block diagram illustrating a playback system 
having only one stream output unit. 

In figure 16, a playback system is constituted such that a 
stream outputted from a stream output unit 240 is played by 
plural data players 204, 205 and 206. In this case, the stream, 
the real time data, and the real position data are multiplexed by 
a multiplexer 250 and, before the multiplexed stream and data is 
input to the data players 204, 205, and 206, it is separated into 
the stream, the real time data, and the real position data by 
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demultiplexers 261, 262, and 263, respectively. Thereby, the 
number of lines used for transmission is reduced. 'Only the real 
time data and the real position data may be multiplexed by the 
multiplexer 250. 

Another example of a playback system according to the fifth 
embodiment is shown in figure 17. 

In figure 17, a decoding means 231 extracts the data 
indicating time or the like from the data embedded in the stream 
and outputs timing data, and a control means 211 transmits the 
timing data through a transmission means 271 of a control data 
transmission apparatus 270 to a key transmission means 272. The 
key transmission means 272 calculates the key transmission timing 
from the timing data, and outputs an encrypted key. The 
transmission means 271 transmits the encrypted key, the real time 
data output ted from the real time data measuring means 221, and 
the real position data outputted from the real position measuring 
means 222 to the control means 211 of the data player 207. The 
control means 211 generates a key from the encrypted key ' received, 
and outputs it to the decoding means 231. At the same time, the 
control means 211 outputs the received real time data and real 
position data to the data embedding means 220. In this 
construction, the data player 207 cannot obtain the key for 
decoding encryption and therefore cannot play the stream unless 
it receives the real time data and the real position data. 

While m this fifth embodiment the playback system-is 
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provided with both of the real time measuring means 221 and the 
real position measuring means 222, one of these means may be 
dispensed with. 
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WHAT IS CLAIMED IS: 

1 . A data player for reading contents encrypted by ,a decoding 
key from a digital medium, and playing the encrypted contents by 
using the decoding key which is stored in a key storage unit, 
said data player comprising: 

key obtaining means for performing mutual authentication with 
the key storage unit to obtain the decoding key stored in the key 
storage unit; 

key holding means for holding the decoding key; 

playback state obtaining means for monitoring the playback 
state of the digital medium; and 

contents decoding means for decoding the encrypted contents 
by using the decoding key; 

wherein the decoding key is obtained by the key obtaining 
means and stored in the key holding means, the encrypted contents 
read from the digital medium is decoded with the decoding key by 
the contents decoding means to play the contents, and the 
decoding key stoxed in the key holding means is discarded 
according to the playback state of the digital medium which is 
obtained by the playback state obtaining means . 

2. The data player of Claim 1, wherein the decoding key stored 
in the key holding means is discarded when it is confirmed that 
the playback state of the digital medium has become "STOP STATE". 
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3. The data player of Claim 1, wherein said digital medium is a 
DVD. 

4. The data player of Claim 2, wherein said digital medium is a 
DVD. 

5. A data player for reading contents encrypted by 'a contents 
key and the contents key encrypted by a decoding key, from a 
digital medium, and playing the encrypted contents by using the 
decoding key which is stored in a key storage unit, said data 
player comprising : 

key obtaining means for performing mutual authentication with 
the key storage unit to obtain the decoding key stored in the key 
storage unit; 

key holding means for holding the decoding key; 

playback state obtaining means for monitoring the playback 
state of the digital medium; 

encrypted contents key decoding means for decoding the 
encrypted contents key by using the decoding key to obtain the 
contents key; and 

encrypted contents decoding means for decoding the encrypted 
contents by using the contents key; 

wherein the decoding key is obtained by the key obtaining 
means and stored in the key holding unit/ the encrypted contents 
key read from the digital medium is decoded with -the decoding key 
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by the contents key decoding means to obtain the contents key, 
the encrypted contents read from the digital medium is decoded by 
using the contents key to play the contents, and the decoding key 
stored in the key holding means is discarded according to the 
playback state of the digital media which is obtained by the 
playback state obtaining means. 

6. The data player of Claim 5, wherein the decoding key stored 
in the key holding means is discarded when it is confirmed that 
the playback state of the digital medium has become "STOP STATE" . 

7. The data player of Claim 5, wherein said digital medium is a 

DVD . 

8. The data player of Claim 6, wherein said digital medium is a 
DVD . 

9. A key storage device comprising: 

decoding key storage means for storing a decoding key for 

decoding encrypted data recorded on a digital medium; 

key read authorization means for authorizing an external 
device to read the decoding key when the external device plays 
the encrypted data; and 

key read history recording means for recording the .readout 
record of the decoding key to the external device; " = 
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wherein, said decoding key includes available period data 
which is the available period for reading the decoding key; and 

said key read authorization means receives a key request 
signal including a key read time which is the time' -when the 
external device made a request to read the decoding key, and ' 
authorizes the external device to read the decoding key after 
confirming that the key read time is later than the -latest time 
amongst the read history data of the decoding key which is stored 
in the key read history storage means, and that the key request 
time is within the key read available period, and that the key 
read history data has been recorded by the key read history 
recording means. 

10. The key storage device of Claim 9, wherein said key read 
history recording unit generates and records, in addition to the 
key read history data, an alteration detection code by which 
alteration on the key read history data can be detected. 

11. The key storage device of Claim 9, wherein said key read 
authorization means authorizes the external device to read the 
decoding key after confirming that the key read history - data is 
not altered, from the alteration detection code added to the key 
read history data. 

12. The key storage device of Claim 10, wherein .said key read 



authorization means authorizes the external device to read the 
decoding key after confirming that the key read history data is 
not altered, from the alteration detection code added to the key 
read history data. 

13. The key storage device of Claim 9, wherein: 

said key read history recording means has a predetermined 
storage capacity; and 

said key read authorization means does not authorize the 
external device to read the decoding key when the key read 
history data has reached the storage capacity of the key read 
history recording means. 

14. A data player for reading data encrypted by a decoding key 
from a digital medium, and playing the data, comprising: 

key obtaining means for obtaining the decoding key for 
decoding the encrypted data, from a key storage unit which stores 
the decoding key; 

decoding means for decoding the encrypted data obtained from 
the digital medium, by using the decoding key; 

data embedding means for embedding data in the data decoded 
by the decoding means; and 

device ID code storage means for storing the device ID code 

of this data player; 

wherein said decoding key is obtained by the key obtaining 
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means, and a key read time at which a request to read the 
decoding key was made and the device ID code of the data player 
are embedded in the decoded data by the data embedding means. 

15. The data player of Claim 14, wherein: 

said key obtaining means reads the ID code of the key -storage 
unit which stores the decoding key, together with the decoding 
key, from the key storage unit; and 

said data embedding means further embeds the ID code of the 
key storage unit in the decoded data. 

16. The data player of Claim 14, wherein: 

said data embedding means comprises sequence generation means 
for converting a pattern to be embedded to a sequence to be 
embedded in each video frame, and embedding means for embedding 
the sequence in each video frame by watermarking; and 

said sequence generation means converts the pattern to be 
embedded to the sequence to be embedded such- that short-period 
patterns and a long-period pattern are mixed in the sequence; 
said short-period patterns are obtained by dividing the pattern 
to be embedded according to the number of bits to be embedded in 
each frame and embedding the bits in each frame, and said long- 
period pattern is obtained by dividing the pattern to be embedded, 
bit by bit, and embedding the divided bits over plural frames 
which are plural times as many as the number, into .which the 
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pattern to be embedded is divided. 

17. The data player of Claim 15, wherein: 

said data embedding means comprises sequence generation means 
for converting a pattern to be embedded to a sequence to be 
embedded in each video frame, and embedding means for embedding 
the sequence in each video frame by watermarking; snd 

said sequence generation means converts the pattern to be 
embedded to the sequence to be embedded such that short-period 
patterns and a long-period pattern are mixed in the -sequence, 
said short-period patterns are obtained by dividing the pattern 
to be embedded according to the number of bits to be embedded in 
each frame and embedding the bits in each frame, and said long- 
period pattern is obtained by dividing the pattern to be embedded, 
bit by bit, and embedding the divided bits over plural frames 
which are plural times as many as the number into which the 
pattern to be embedded is divided. 

18. The data player of Claim 16, wherein said key obtaining 
means generates a key read history signal including the key read 
time and the device ID code of this data player, and transmits 
this signal to the key storage unit which stores 'the decoding key. 

19. A digital ' contents player for reading data encrypted by a 
decoding key from a digital medium, and playing the data, 



73 



comprising: 

key storage means for storing the decoding key for decoding 
the encrypted data; and 

data playback means for reading the decoding 'key from the key 
storage means, and playing the data using the decoding key; 

wherein said data playback means and said key storage means 
are removable from each other; and 

when said data playback means reads the decoding key, said 
key storage means records key read history data including a 
device ID code of this digital contents player and a key read 
time when a request to read the decoding key was made; and 

said data playback means embeds the key read time and the 
device ID code in the data played with the decoding key; 

20, The digital contents player of Claim 19 wherein: 

said data to be embedded is converted into a sequence to be 
embedded in each video frame, and then embedded by watermarking; 
and 

said sequence to be embedded is a mixture of short-period 
patterns and a long-period pattern, said short-period patterns 
are obtained by dividing the pattern to be embedded according to 
the number of bits to be embedded in each frame and embedding the 
bits in each frame, and said long-period pattern is obtained by 
dividing the pattern to be embedded, bit by bit, and embedding 
the divided bits over plural frames which are plural times as 



74 

many as the number into which the pattern to be embedded is 
divided. 

21. A key read history recording method comprising the steps of: 
recording available period data which is the available period 

for reading a decoding key for decoding encrypted data; 

recording, as a key nonuse period, a difference between a key 
read time when a request to read the decoding key was made and a 
time which has been recorded at a time that is previous and 
nearest to the key read time; " - 

recording key read history data including the key lead time 
and the device ID code of a data player; and 

recording the time when use of the decoding key has ended, as 
an end-of -key-use time. 

22. A data embedding apparatus comprising: 

sequence generation means for converting a pattern to be 
embedded into a sequence to be embedded in each video frame; and 

embedding means for embedding the sequence in each video 
frame by watermarking; 

wherein said sequence generation means converts the pattern 
to be embedded into the sequence to be embedded such that short- 
period patterns and a long-period pattern are mixed in the 
sequence, said short-period patterns are obtained by dividing the 
pattern to be embedded according to the number of bits to be 
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embedded in each frame and embedding the bits in each frame, and 
said long-period pattern is obtained by dividing the pattern to 
be embedded, bit by bit, and embedding the divided- -bits . over 
plural frames which are plural times as many as the number into 
which the pattern to be embedded is divided. 

23. A data embedding apparatus comprising: 

real time measuring means for outputting real time data 
which specifies the present time; and 

data embedding means for embedding the real time data in 
video/audio data. 

24. The data embedding apparatus of Claim 23, wherein said data 
embedding means embeds the real time data at the time when the 
video/audio data is input to this apparatus, in the video/audio 
data which is input in the visible/audible state to this 
apparatus, 

25. A data embedding apparatus comprising: 

real position measuring means for outputting real position 
data which specifies the present physical position; and - 

data embedding means for embedding the real position data in 
video/audio data. 



26. The data embedding apparatus of Claim 25, wherein said data 
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embedding means embeds the real position data at the time when 
the video/audio data is input to this apparatus, in the 
video/audio data which is input in the visible/audibTe state to 
this apparatus. 

27. A data embedding method comprising: 

a real time measuring step of outputting real time data which 
specifies the present time; and 

a data embedding step of embedding the real time data in 
video/audio data. * - 

28. The data embedding method of Claim 27 wherein the real time 
data at the time when the video/audio data is input, is embedded 
in the video/audio data which is input in the visible/audible 
state . 

29. A data embedding method comprising: 

a real position measuring step of outputting real position 
data which specifies the present position; and 

a data embedding step of embedding the real position data in 
video/audio data, 

30. The data embedding method of Claim 29 wherein the real 
position data at the time when the video/audio data_ is input, is 
embedded in the video/audio data which is input -in the 
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visible/audible state . 

31. An embedded data detection apparatus for detecting embedded 
data from playback data in which the data is embedded by a data 
embedding apparatus which comprises: sequence generation means 
for generating a sequence in which short-period patterns and a 
long-period pattern are mixed, said short-period patterns being 
obtained by dividing a pattern to be embe,dded according to the 
number of bits to be embedded in each frame and embedding the 
bits in each frame, and said long-period pattern being obtained 
by dividing the pattern to be embedded, bit by bit, and embedding 
the divided values over plural frames which are plural times as 
many as the number into which the pattern to be embedded is 
divided; and data embedding means for embedding the sequence in 
each video frame by watermarking; 

said embedded data detection apparatus comprising: 

intra-frame embedded data detection means for detecting the 
embedded pattern from each video frame; 

short-period embedded pattern detection means for calculating 
the embedded' pattern from the embedded pattern detected by the 
intra-frame embedded data detection means, with reference to 
shirt-circuit embedded bits; and 

long-period embedded pattern detection means for calculating 
the embedded pattern with reference to long-period embedded bits. 
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32. An embedded data confirming method comprising the steps of: 
detecting embedded data from visible/audible data in which 

real time data that can specify the present time, real position 
data that can specify the present position, or a device ID code 
of a device for playing the visible /audible data is embedded; and 

collating the detected data with a data base containing the 
history of the embedded data. 

33. A playback system comprising a data output unit for 
outputting data, and a data player, said data player comprising 
decoding means for decoding input data to video/audio data which 
is visible or audible, real time measuring means for outputting 
real time data which can specify the present time, and data 
embedding means for embedding the real time data in the 
video/audio data, 

wherein the real time data measured by the real time 
measuring means at the time when the data player plays the input 
data is embedded in the video/audio data. 

34. The playback system of Claim 33 comprising one piece of said 
real time measuring means, and at least one piece of said data 
output unit . 

35. A playback system comprising a data output unit- for 
outputting data, and a data player, said data player comprising 
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decoding means for decoding input data to video/audio data which 
is visible or audible, real position measuring means for 
outputting real position data which can specify the present 
position, and data embedding means for embedding the real 
position data in the video/audio data, 

wherein the real position data measured by the^ real position 
measuring means at the time when the data player plays the input 
data is embedded in the video/audio data. 

36. The playback system of Claim 35 comprising one piece of said 
real positron measuring means, and at least one piece of said 
data output unit. 
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ABSTRACT OF THE DISCLOSURE 

A data player for reading contents encrypted by" a decoding 
key from a digital medium, and playing the encrypted contents by 
using the decoding key which is stored in a key storage unit, 
comprises: a key obtaining unit for performing mutual 
authentication with the key storage unit to obtain ~the decoding 
key stored in the key storage unit; a key holding unit for 
holding the decoding key; a playback state obtaining unit for 
monitoring the playback state of the digital medium; .and a 
contents decoding unit for decoding the encrypted contents by 
using the decoding key. The decoding key is obtained by the key 
obtaining unit and stored in the key holding unit, and the 
encrypted contents read from the digital medium is- decoded with 
the decoding key by the contents decoding unit to play the 
contents. The decoding key stored in the key holding unit is 
discarded according to the playback state of the digital medium 
which is obtained by the playback state obtaining unit. 
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DECLARATION AND POWER OF ATTORNEY FOR U.S. PATENT APPLICATION 
(x) Original () Supplemental () Substitute () PCT () DESIGN 

As a below named inventor, I hereby declare that: my residence, post office address and citizenship are as stated below next 
to my name; that I verily believe that I am the original, first and sole inventor (if only one name is listed below) or an original, first and 
joint inventor (if plural inventors are named below) of the subject matter which is claimed and for which a patent is sought on the 
invention entitled: 

Title: DATA PLAYER. DIGITAL CONTENTS PLAYER. PLAYBACK SYSTEM. DATA EMBEDDING APPARATUS, AND 
EMBEDDED DATA DETECTION APPARATUS 

of which is described and claimed in: 
0 the attached specification, or 

(x) the specification in application Serial No. , filed August 18, 2000 , and with amendments through (if applicable), 

or 

0 the specification in International Application No. , filed , and as amended on (if applicable). 

1 hereby state that I have reviewed and understand the content of the above-identified specification, including the claims, as amended 
by any amendment(s) referred to above. 

I acknowledge my duty to disclose to the Patent and Trademark Office all information known to me to be material to patentability as 
defined in Title 37, Code of Federal Regulations, §1.56. 



I hereby claim priority benefits under Title 35, United States Code, §119 (and §172 if this application is for a Design) of any 
application(s) for patent or inventor's certificate listed below and have also identified below any application for patent or inventor's 
certificate having a filing date before that of the application on which priority is claimed: 



COUNTRY 


APPLICATION NO. 


DATE OF FILING 


PRIORITY 
CLAIMED 


Japan 


11-233813 


August 20, 1999 


YES 


Japan 


11-233814 


August 20, 1999 


YES 


Japan 


11-233815 


August 20, 1999 


YES 



I hereby claim the benefit under Title 35, United States Code §120 of any United States application(s) listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in the prior United States application in the manner provided by 
the first paragraph of Title 35, United States Code §112, I acknowledge the duty to disclose information material to patentability as 
defined in Title 37, Code of Federal Regulations, §1.56 which occurred between the filing date of the prior application and the national 
or PCT international filing date of this application: 



APPLICATION SERIAL NO. 


U.S. FILING DATE 


STATUS: PATENTED, PENDING, 
ABANDONED 















And I hereby appoint Michael R. Davis, Reg. No. 25,134; Matthew M. Jacob, Reg. No. 25,154; Jeffrey Nolton, Reg. No. 25,408; 
Warren M. Cheek, Jr., Reg. No. 33,367; Nils Pedersen, Reg. No. 33,145; and Charles R. Watts, Reg. No. 33,142, who together 
constitute the firm of WENDEROTH, LIND & PONACK, L.L. P., jointly and severally, attorneys to prosecute this application and to 
transact all business in the U.S. Patent and Trademark Office connected therewith. 



I hereby authorize the U.S. attorneys named herein to accept and follow instructions from HAYASE&CO. as to any action to be taken 
in the U .S . Patent and Trademark Office regarding this application without direct communication between the U . S . attorneys and myself. 
In the event of a change in the persons from whom instructions may be taken, the U.S. attorneys named herein will be so notified by 
me. 



Send Correspondence to 



Direct Telephone Calls to: 



WENDEROTH, LIND & PONACK, L.L.P. WENDEROTH, LIND & PONACK, L.L.P. 

2033 K Street, N.W., Suite 800 Area Code (202) 721-8200 

Washington, D.C. 20006 

Direct Facsimile Messages to: 

Area Code (202) 721-8250 



Full Name of 
First Inventor 


FAMILY NAME FIRST GIVEN NAME SECOND GIVEN NAME 

KAWADA Hirotsugu 


Citizenship 


CITY STATE OR COUNTRY COUNTRY OF CITIZENSHIP 

Osaka Japan Japan 


Post Office 
Address 


ADDRESS CITY STATE OR COUNTRY ZIP CODE 

7-3-3, Uenoshibacho, Sakai-shi, Osaka, 593-8301 Japan 


Full Name of 
Second Inventor 


FAMILY NAME FIRST GIVEN NAME SECOND GIVEN NAME 

KATTA Noboru 


Citizenship 


CITY STATE OR COUNTRY COUNTRY OF CITIZENSHIP 

Hyogo Japan Japan 


Post Office 
Address 


ADDRESS CITY STATE OR COUNTRY ZIP CODE 

1-49-1, Mizugaoka, Itami-shi, Hyogo 664-0017, Japan 


Full Name of 
Third Inventor 


FAMILY NAME FIRST GIVEN NAME SECOND GIVEN NAME 

LBARAKI Susumu 


Residence & 
Citizenship 


CITY STATE OR COUNTRY COUNTRY OF CITIZENSHIP 

Osaka Japan Japan 


Post Office 
Address 


ADDRESS CITY STATE OR COUNTRY ZIP CODE 

3-23-A-302, Higashitoyonakacho, Toyonaka-shi, Osaka 560-0003 Japan 


Full Name of 
Fourth Inventor 


FAMILY NAME FIRST GIVEN NAME SECOND GIVEN NAME 

TATEBAYASHI Makoto 


Citizenship 


CITY STATE OR COUNTRY COUNTRY OF CITIZENSHIP 

Hyogo Japan Japan 


Post Office 
Address 


ADDRESS CITY STATE OR COUNTRY ZIP CODE 

1-16-21, Mefii, Takarazuka-shi, Hyogo 665-0852 Japan 


Full Name of 
Fifth Inventor 


FAMILY NAME FIRST GIVEN NAME SECOND GIVEN NAME 

HARADA Shunji 


Residence & 
Citizenship 


CITY STATE OR COUNTRY COUNTRY OF CITIZENSHIP 

Osaka Japan Japan 


Post Office 
Address 


ADDRESS CITY STATE OR COUNTRY ZIP CODE 

2-20-52, Tamadenishi, Nishinari-ku, Osaka-shi, Osaka 557-0045 Japan 


Full Name of 
Sixth Inventor 


FAMILY NAME FIRST GIVEN NAME SECOND GIVEN NAME 


Residence & 
Citizenship 


CITY STATE OR COUNTRY COUNTRY OF CITIZENSHIP 


Post Office 
Address 


ADDRESS CITY STATE OR COUNTRY ZIP CODE 
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I further declare that all statements made herein of my own knowledge are true, and that all statements on information and belief are believed 
to be true; and further that these statements were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize 
the validity of the application or any patent issuing thereon. 



1st Inventor — Date - 

Hirotsugu KAWADA 

2nd Inventor Date _ 

Noboru KATTA 

3rd Inventor „ Date - 

Susumu IBARAKI 

4th Inventor — Date - 

Makoto TATEBAYASHI 
5th Inventor Date - 

Shunji HARADA 

6th Inventor „ Date - 



The above application may be more particularly identified as follows: 

U.S. Application Serial No. Filing Date August 18. 2000 

Applicant Reference Number P-23 109-01 Atty Docket No. 2000 1134A 

Title of Invention DATA PLAYER. DIGITAL CONTENTS PLAYER. PLAYBACK SYSTEM. DATA EMBEDDING APPARATUS, AND 
EMBEDDED DATA DETECTION APPARATUS 
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